Web Survey Bibliography
There are several alternative response formats available to the Web survey designer. These include radio button, check boxes, drop boxes and text fields. The choice of these HTML form elements is often made with little consideration of measurement error, but rather for reasons of efficiency or space. In this paper we explore three common forms of presenting response options to a single choice question. Specifically, we examine a series of radio buttons, a drop box with none of the items initially displayed until the respondent clicks on the box, and a scrollable drop box with five of the ten options initially visible, requiring the respondent to scroll to see the remainder of the items. In addition we reversed the order of the response options for half of the sample, yielding a 3*2 experimental design. This experiment was embedded in a survey administered to a sample from an online panel administered by Survey Sampling, Inc., yielding over 2,500 respondents, with random assignment to the six conditions. We explore the effect of order and format on the responses obtained to two different questions, one on breakfast cereal nutrients and the other on desirable automobile features. We discuss the implications of our findings both for Web survey design and for the literature on response effects and satisficing. We generally find support for the primacy effects found in the literature on visually-presented items, but also find some surprises in terms of the effect of format and in terms of the time taken to complete the items.
Homepage - conference (abstract)
Journal Homepage (abstract) / (full text)
2003
Conferences, workshops, tutorials, presentations
Web survey bibliography - Crawford, S. D. (25)
- The Effect of Mobile Web Survey Design on Screen Orientation Manipulation; 2014; Young, R.H.; Crawford, S. D.; Couper, M. P.; Nelson, T. F.
- Understanding Mobility: Consent and Capture of Geolocation Data in Web Surveys; 2014; Crawford, S. D.; McClain, C.; Young, R.H.; Nelson, T. F.
- Grid Formats, Data Quality, and Mobile Device Use: A Questionnaire Design Approach; 2013; McClain, C., Crawford, S. D.
- Examining the Feasibility of SMS as a Contact Mode for a College Student Survey; 2013; Crawford, S. D., McClain, C., O'Brien, S., Nelson, T. F.
- Web Survey Live Validations - What Are They Doing?; 2011; Crawford, S. D., McClain, C.
- Multi-Mode and Method Experiment in a Study of Nurses; 2010; Friese, C. R., Lee, C. S., O'Brien, S., Crawford, S. D.
- The Impact of Textual Messages of Encouragement on Web Survey Breakoffs: An Experiment ; 2009; Sakshaug, J. W., Crawford, S. D.
- Do Tailored Messages of Encouragement Reduce Web Survey Break-offs?; 2007; Sakshaug, J. W., Crawford, S. D., Inkelas, K. K.
- Web-Based Consent Form Design: An Experiment with Two Populations; 2006; Crawford, S. D., Eisenberg, D., Wimsatt, L., Golberstein, E.
- Using Interactive Web-Based Maps; 2006; Sinibaldi, J., Showen, S., Crawford, S. D., Saltz, R.
- The Social Science Web Survey System: Moving from 2.0 to 3.0; 2006; Crawford, S. D.
- Web Survey Design: Paging versus Scrolling; 2006; Peytchev, A., Couper, M. P., McCabe, S. E., Crawford, S. D.
- Unintended Consequences of Incentive Induced Response Rate Differences; 2005; Pope, D., Crawford, S. D., Johnson, E. O., McCabe, S. E.
- Using the Web to Survey College Students: Institutional Characteristics That Influence Survey Quality...; 2005; Crawford, S. D., McCabe, S. E., Inkelas, K. K.
- Mode effects for collecting alcohol and tobacco data among 3rd and 4th grade students: A randomized...; 2005; McCabe, S. E., Boyd, C. J., Young, A., Crawford, S. D., Pope, D.
- Developmnent and testing of web questionnaires; 2004; Baker, R. P., Crawford, S. D., Swinehart, J.
- Web Survey Design: Paging vs. Scrolling; 2004; Peytchev, A., Crawford, S. D., McCabe, S. E., Conrad, F. G., Couper, M. P.
- Validations in Web-based Surveys; 2003; Crawford, S. D., Peytchev, A.
- What They See Is What We Get: Response Options for Web Surveys; 2003; Couper, M. P., Tourangeau, R., Conrad, F. G., Crawford, S. D.
- The local/global decision in Internet research; 2002; Crawford, S. D., Jones, S., Rowen, C.
- Evaluation of Web Survey Data Collection Systems; 2002; Crawford, S. D.
- From Mail to Web: Improving Response Rates and Data Collection Efficiencies; 2002; Crawford, S. D., McCabe, S. E., Couper, M. P., Boyd, C. J.
- Testing Web Questionnaires; 2002; Crawford, S. D., Baker, R. P.
- A Nonresponse Analysis of a Mail-Web Mode Comparison; 2002; Boyd, C. J., Crawford, S. D., McCabe, S. E., Couper, M. P.
- Experiments on column width spacing in the University of Michigan Student Life Survey; 2001; Boyd, C. J., McCabe, S. E., Couper, M. P., Crawford, S. D.